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1, INTRODUCTION 

Building footprints are very important data in many fields, such as in updating the cadastral 
database, quality checking for existing footprint or map, city-based planning, DEM (digital elevation model) 
acquisition, vegetation monitoring, telecommunication, and 3D city modelling [1]. Town planning 
department requires latest information regarding the specific features at the development area. One of the 
important feature is building footprint. The building footprint will determine the design of the new 
development area. Therefore, the fast building footprint data acquisition is very important to speed up the 
planning stage [2-3]. The development of automated solutions of building footprints has increased in order to 
speed up the process, as well as to reduce the costs of the process. Some works that use aerial and satellite are 
able to detect buildings and delineate their footprints by using images and exploiting shadows or by 
generating DSM or by using multi-spectral information [4]. Nowadays, the current techniques to extract 
building footprints frequently involve Light Detection and Ranging (LiDAR) and satellite images, which are 
mostly done in manual and rely largely on architectural blueprints or skilled modellers [5]. As in LIDAR 
technique, certain aspects are not correctly removed due to ‘debris’ or small building being left out during the 
extraction process [6]. Vegetation or tree that ‘interferes’ with the urban features is also a problem in 
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extracting building footprints. Thus, it 1s recommended for the vegetation and trees to be selected and 
removed during the pre-processing stage [7]. As in satellite images, the accuracy of the technique is affected 
with the measured shadows and the surrounding environments. 

Conventionally, the manned aircraft is used to capture aerial images, but now, many projects are 
accomplished by using UAVs [8-9]. The advantage of aerial photogrammetry, it reduces field work, 
for example, when certain data are absent or the information has to be re-evaluated, it can be done in the 
office using the photograph, which makes the aerial photogrammetry faster as there is no need to perform 
field work [10]. Other than that, it is more efficient to map a large area by using aerial photogrammetry than 
the traditional survey methods [11]. UAV photogrammetry is a new photogrammetric measurement tool. 
UAV photogrammetry has discovered numerous new applications in the close range that introduce an 
inexpensive option to the conventionally-manned aerial photogrammetry [12-13]. The image quality is better 
than the satellite imagery as it is located at 100,000 km from the surface of the earth. Satellite images has 
different resolutions based on its specific sensors [14]. UAV images can provide small ground sampling 
distance compared to satellite images [15]. Nowadays, UAVs can be used as a particular, automatic and 
computer-controlled data acquisition and measurement platform, with the latest developments of economical 
sensors, including off-the-shelf virtual cameras, GPS / INS (Global Positioning System device / Inertial 
Navigation System device), navigation unit, and laser scanner [16]. 

In the geomatics field, UAV systems and their applications have been vastly investigated regarding 
their regulations and data processing [17]. Typical image-based aerial surveying with an UAV platform 
needs flight mission planning and ground control points (GCPs) measurement for geo-referencing functions. 
After that, the images can be used for stitching and mosaicking purposes or they can be used as input for a 
photogrammetric process [18]. The final products can be used for the production of orthoimages, 
3D modelling applications, or for the extraction of further metric information. The different image processing 
technique might cause the accuracy of photogrammetric results. There are a lot of commercial software 
available in the open market. The user need to determine the correct technique to achieve the desired 
results [19]. The different align photo and build dense algorithm applied during photogrammetric image 
processing will effect the end products. Therefore, this study investigates the accuracy of different align 
photo and build dense during photogrammetric image processing specifically for building footprints [20]. 

In order to obtain more accurate results, some researchers used the fusion of different data sources, 
for example, synthetic aperture radar (SAR) with optical image fusion or LiDAR with optical image 
fusion [21]. Other than that, the manual techniques in obtaining the building footprints are labour intensive, 
slow, and expensive. Therefore, the UAV is proposed to acquire aerial imagery in this study as it is more 
efficient, time-saving, and inexpensive, especially for small budget projects. This study evaluated building 
footprints from different UAV platforms. 


2. RESEARCH METHOD 

The methodology is divided into four phases. Phase | consists of preliminary study, including site 
reconnaissance. Site Reconnaissance was carried out at buildings with perfect geometry for validation 
purposes. This location is also suitable for UAV studies because it has sufficient space for UAV launching 
and landing. This phase also covers the selection hardware and software for the study. Phantom 3 
Professional was used for image acquisition for multi rotor UAV, while eBee was applied for fixed wing 
UAV, and other hardware used had been laptop, mobile phone, and transmitter as shown in Figure 1. It is 
important to determine the condition of the hardware prior to image acquisition so as to avoid any damage or 
system failure during the flight mission. 





Figure 1. Phantom 3 Professional [22] and eBee [23] 
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All acquired images were processed using Agisoft software. Agisoft PhotoScan is a 
photogrammetric software solution for automatic generation of dense point clouds, textured polygonal 
models, georeferenced true orthomosaics, and DSMs/DTMs from images. It allows rapid processing with 
highly accurate results. Agisoft PhotoScan is capable of processing thousands of photos, yet all the 
processing is performed locally, without the need to transmit the data outside the company [24]. Phase 2 
refers to data collection that includes camera calibration, UAV calibration, and flight planning. Camera 
calibration is the important part that was performed prior to flight planning. The camera was calibrated in 
order to assess the condition of the camera before data collection. Thus, the reliability of the camera was 
determined. In this study, two types of UAV were used to capture the images at the study area. All factors 
were considered because any problem that occurs during image acquisition would lead to poor images that 
cannot be used for data processing. The PhotoModeler software was used to perform the camera 
calibration process. 

A self-camera calibration was conducted to carry out the camera configuration that can determine 
the position of the main principle point, the main range focal length, and the optical distortion coefficients. 
The process began with the calibration sheet printed from the software that was standardised with the 
calibration point on a piece of paper with a certain size. The procedure for Phantom 3 Pro IMU calibration 
took between 5 and 10 minutes. The Phantom 3 Pro should not be moved at all during the IMU calibration 
process, otherwise the procedure would fail. If the IMU is out of sync, this procedure may need to be done 
more than once. Hence, the Phantom 3 Pro was placed on a flat surface. Next, spirit or bubble level was 
employed to check for a nice flat surface. The flight planning is an important stage, which required planning 
after the reconnaissance stage. The condition of the study area was explored before the flight mission in order 
to find the best location for the hovering and landing of UAV during the flight mission. The location of 
hovering and landing usually requires 10 meter radius [25]. 

In this study, the Altizure was used to create the flight planning for image capture. The objective of 
the flight planning was to determine the total number of flight lines and to determine the amount of time 
needed to fly and to capture the entire study area. The flight planning is an important aspect that is related to 
cost and time. The altitude was set at 100 m, while the overlap was 70%, and the side lap was 50%. Phase 3 
covers data processing where all the acquired images were processed. This process is also known as post- 
processing. The UAV raw images were downloaded into a computer after a flight mission was completed. 
The quality of images was verified prior to the processing stage. Some of the images might have some 
quality issues, such as blurred images and colour balancing error, which can be caused during flight mission. 
Agisoft PhotoScan Software was used to process the images, and three levels of accuracy could be opted 
from the Align Photos (AP), which are high, medium, and low. Other than that, five levels of accuracy are 
available in Build Dense Cloud (BDC), which are ultra-high, high, medium, low, and lowest. Every level of 
accuracy was employed in this study to observe the effect on the results. A total of thirty UAV images were 
processed using Agisoft PhotoScan software. Figure 2 illustrates the UAV image processing which highlights 
the different methods in align photo and to build dense cloud. 

All images obtained during data acquisition were imported to Agisoft PhotoScan software. 
Then, automatically, the images were set in their position because the images were geotagged with the 
coordinates during image acquisition. All images were self-oriented after importing them into this software. 
After the images were imported, the images had to be aligned and continued with Place Markers for Ground 
Control Points (GCP) and Verification Points (VP) to be marked in the images. The GCPs were used to 
determine the position of its aerial photo image in the coordinate system. VPs were used to check on the 
accuracy assessment of photogrammetric results of the study area. Next, the analyses were preceded with 
Build Dense Cloud, Build Mesh, Build Texture, Generate DSM, and Generate Orthophoto. 

As the DSM, DTM, and orthophoto were obtained from the Agisoft PhotoScan Software, the results 
were processed by using ArcGIS for building extraction. From the generated DSM and DTM, the parameters 
considered to distinguish the building from other features had been the height and the area. Non-building 
features and all other short features were eliminated. Smaller features that may be extracted as buildings were 
resolved by filtering the extracted features according to its area. All the preliminary values considered in all 
the extractions had been based on the characteristics of the buildings and structures built in the study area, 
thus reflecting the actual observation. The final step of the building extraction refers to the simplification of 
the polygons extracted to eliminate irregular-shaped features as shown in Figure 3. Phase 4 covers data 
analysis of building footprints using fixed wing UAV and multi rotor UAV, while the outcomes of building 
footprints from different UAV platforms with existing layout plans were analysed. The outcomes of building 
footprints were evaluated in terms of area. 
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Figure 2. Processing for different method in align photo and build dense cloud 





Figure 3. NDSM-Extract by Height-Extract by Area-Raster to Vector-Building Simplification 


3. RESULTS AND ANALYSIS 

There are DIM, DSM, and Orthophoto as the results from each time the UAV images were 
processed in Agisoft PhotoScan Software. The results from Agisoft PhotoScan Software, such as DTM, 
DSM, and orthophoto, were processed in ArcGIS to extract the buildings. The actual data for this study had 
been based on the existing layout plans, which was the area of the buildings. The comparison of area between 
Multi Rotor UAV and Fixed Wing UAV was analysed into three main align photos: high align, medium 
align, and low align. Each main align photo had five different build dense accuracy levels. The result for 
high, medium and low align photo for five different build dense accuracy levels is shown in Figure 4. 

Figure 4 shows the high, medium and low align photo for all build dense cloud almost have similar 
pattern except lowest build dense cloud represents a few spikes. The high align photo shows the consistent 
graph for all samples while the medium and low align photo show the inconsistencies of the results. 
The differences for all samples between multi rotor and fixed wing UAV illustrate in Table 1. 

Table 1 shows the large different for high and medium align for most build dense cloud in all 
samples. It 1s because the multi rotor and fixed wing UAV platform produced the different results which 
effect the extraction of building footprint. The different for low align records small different except for 
several samples. The results for high and medium align show the maximum RMSE value in multi rotor and 
fixed wing UAV appear to be the lowest build dense, while the minimum RMSE value in ultra-high build 
dense. The result for low align shows the maximum RMSE value in multi rotor UAV appears to be the 
lowest build dense, while the minimum RMSE value in medium build dense. Other than that, the maximum 
RMSE value in fixed wing UAV seems to be the lowest build dense, while the minimum RMSE value in 
ultra-high build dense as shown in Figure 5. 
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Figure 4. Results; a) high align photo, b) medium align photo, c) low align photo 
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Table 1. Different between Multi Rotor and Fixed Wing UAV for High Align Photo (Area) 


one 
Ultra-high 19.66 
High 8.90 
Medium 9.74 
Low 90.26 
Lowest 23.96 
Ultra-high 41.77 
High 83.92 
Medium 107.00 
Low 150.32 
Lowest 14.29 
Ultra-high 13.10 
High 10.80 
Medium 10.68 
Low 26.31 
Lowest 25.16 
Actual Area 1977.29 


Two 
2.93 
14.09 
3.58 
119.43 
126.52 


7.86 

100.22 
140.40 
157.97 
185.55 


0.05 
2.02 
1.94 
209.71 
10.73 


1964.02 


Three 
45.88 
2142 
108.83 
137.57 
12.27 


6.52 
88.94 
137.08 
7.07 
174.74 


eee) 
13.79 
19.86 
26.34 
227.56 


1304.09 


Sample (m7) 

High Align 
Four Five 
37.88 3.28 
89.07 6.96 
19.07 23.04 
137.25 6.50 
177.47 4.13 

Medium Align 

11.01 59.96 
107.92 L797 
18.00 20.69 
158.50 7.70 
6.34 22.84 

Low Align 
100.53 61.95 
137.46 11.67 
221 153.45 
1.68 4.39 
11.97 1.67 
1300.63 1927.35 


Six 
0.57 
2.78 
dtd 
14.72 
0.51 


59.81 
4.57 
6.61 
158.48 
1.59 


89.06 
126.93 
17.57 
13.46 
33.75 


1945.92 
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Seven 
4.47 
71.28 
22.91 
99.94 
139.22 


0.73 
29.19 
129.46 
130.44 
169.83 


66.97 
111.33 
2.81 
PREIS: 
233.43 


1283.11 


Eight 
1.03 
57.50 
6.61 
3.95 
141.46 


9.78 
0.98 
141.54 
11.18 
184.95 


1.00 
130.86 
11.38 
7.81 
263.95 


1276.38 
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Figure 5. RMSE of Area; a) High, b) Medium, c) Low 


The different between multi rotor and fixed wing illustrate in Table 2. Table 2 shows the different 
between multi rotor and fixed wing for ultra-high build dense records approximately +5m for all align 
photos. It shows that the RMSE of multi rotor UAV is lower than the RMSE of fixed wing UAV for high and 
medium align photos, except for low. Other than that, the high in align photo provides better result than those 
for medium and low, as the RMSE appears to be at its lowest. 


Table 2. Different RMSE between Multi Rotor and Fixed Wing 
High (m*) Medium(m?) — Low (m7?) 


Ultra-High 4.443 5.373 4.785 
High 11.149 9.671 0.644 
Medium 14.303 6.334 3.487 
Low 10.522 4.222 0.244 
Lowest 5.093 7.953 7.935 


4. CONCLUSION 

Based on the RMSE results, the ultra-high of build dense cloud from high in align photo provides 
the best results as the RMSE is 13.648 m2? for multi rotor UAV and 18.091 m? for fixed wing UAV. Overall, 
the measurements from the multi rotor UAV are closer with the measurements from the existing layout plans, 
when compared with the measurements from fixed wing UAV. For future studies, it 1s hoped that different 
types of UAV can be used in image acquisition with varied sensors, weights, and cameras. The different 
methods of building extraction can also be applied in the future studies to increase the accuracy of 
building footprint. 
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